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REFLECTOMETRY APPARATUS AND METHOD 



CROSS REFERENCE TO RELATED APPLICATIONS 

[0001] This application claims the benefit of priority under 35 U.S.C. §1 19(e) from co- 
pending, commonly owned U.S. provisional patent application. Serial No. 60/446,003, 
filed on February 7, 2003, entitled "Linear Light Source Reflectometry Software." The 
entire content of this provisional application is incorporated herein by reference. 

BACKGROUND 

[0002] The wide range of optical properties that are exhibited by materials provides a 
useful source of infomnation about the identity of the materials. Different materials 
reflect, scatter, absorb, and transmit light in different ways, allowing the materials to be 
distinguished by measuring these optical properties. In particular, a lot of materials tend 
to reflect most of the light that is incident on their surfaces and that is not absorbed. 
Therefore, surface reflectance properties are important optical attributes of a material. 

[0003] Acquiring realistic reflectance properties of real-world objects, such as their 
spatially varying colors, specularities, roughnesses, translucencies, and diffuse 
reflectances, can be quite difficult, however. The image acquired from an object 
generally depends not only on its characteristic reflectance properties, but also on the 
conditions of illumination. The process of capturing the radiance of light reflected by an 
object from a full range of incident illumination directions can be lengthy, and can 
require specialized equipment. Surface reflectance properties may often be crafted 
laboriously by hand, using image-editing software. 

[0004] To address these issues, mathematical reflectance models have been developed 
which parameterize an object's bidirectional reflectance distribution function (BDRF). 
The BDRF provides the ratio of the reflected radiance to the incident flux, per unit area, 
for all directions of view and incident illumination. Typically, these analytic reflectance 
models parameterize the BDRF in terms of the diffuse color of the object, the specular 
color of the object, and the specular roughness parameter of the object. This 
parameterization allows these models to be fitted to sparser samples of the BDRF. It 
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can be difficult, Inowever, to reliably estimate both the diffuse and specular components 
of an object's surface reflectance, using these mathematical models with a limited 
number of samples. In particular, parameters obtained by fitting to a limited number of 
samples can grossly mischaracterize the specular properties of a material. 

[0005] Accordingly, there is a need for an apparatus and method that allow both the 
diffuse and the specular reflectance properties of an object to be estimated reliably, 
without requiring excessive amounts of data and/or complex equipment. 

SUMMARY 

[0006] A reflectometry apparatus and method is presented that uses an extended light 
source having an elongated configuration to illuminate an object, instead of using a 
point light source. Using a simple gantry to move the extended light source across an 
object, the light source can be made to provide illumination on an object from a full 
range of directions of incident illumination. The data set resulting from images acquired 
as light from the light source sweeps across a surface of the object provides information 
that is sufficient to reliably estimate both the diffuse and specular reflectance properties 
of the object. 

[0007] A reflectometry apparatus in accordance with one embodiment includes a light 
source adapted to generate light that illuminates at least a portion of a surface of an 
object. The light source has an elongated configuration and extends from one end to 
another end. For example, the light source may be a linear, cylindrical neon tube. In 
one embodiment, the apparatus includes an actuator configured to move the light 
source along a trajectory during a time period so that light from the light source sweeps 
across the surface of the object during the time period. Alternatively, the light source 
may be moved manually by an operator. The apparatus includes a camera configured 
to receive, during this time period, light reflected from the surface, and to generate 
therefrom image data representative of a plurality of images of the object surface. 

[0008] The apparatus includes a data processor configured to process the image data 
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from the camera, so that spatially varying surface reflectance parameters of the object 
can be determined for each point on the surface of the object. These reflectance 
parameters may include the diffuse reflectance parameter, the specular reflectance 
parameter, and the specular roughness parameter. A reflectance trace table is 
synthesized for a range of model parameters using a virtualized rendition of the linear 
light source. For each pixel, the obsen/ed reflectances are compared to the 
synthesized reflectance trace table, to detemnine the reflectance parameters that most 
closely match the observed data. A variation in surface normals and surface heights 
can also be reliably measured, for non-flat surfaces. The translucency parameter can 
also be measured using the above-described apparatus. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] FIG. 1 is a schematic block diagram of a reflectometry apparatus in accordance 
with one embodiment. 

[0010] FIG.s 2A, 2B, 2C, and 2D illustrate the measured reflectance traces for different 
materials. 

[0011] FIG. 3 illustrates the registration of data representative of a reflectance trace, as 
the light source is moved across the object surface. 

[0012] FIG.s 4A, 4B, 4C, and 4D illustrate the fitting of data to a parameterized 
reflectance model, using a pre-computed table of synthesized reflectance traces. 

[0013] FIG. 5 illustrates the use of laser stripe scanning to measure the variations in 
surface geometry of an object. 

[0014] FIG.s 6A and 6B illustrate the measurement of the translucency parameter ptrans 
of an object surface. 

DETAILED DESCRIPTION 

[0015] An apparatus and method is presented that reliably measures both the diffuse 
and the specular reflectance parameters of an object, as well as its translucency and 
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the variation in its surface geometry, by detecting light reflected from the object surface 
while an extended elongated light source is moved over the object surface. 

[0016] FIG. 1 is a schematic block diagram of a reflectometry apparatus 100, 
configured to measure the surface reflectance properties of an object 130, in 
accordance with one embodiment. The reflectometry apparatus 100 has an extended, 
elongated light source 1 10 that is moved across the surface of an object 130 along a 
one-dimensional trajectory, instead of having a point light source that needs to be 
moved across the full two-dimensional hemisphere of incident illumination directions. 
The light source 110 has an elongated configuration extending from one end 1 12 to 
another end 1 14. In this section, a linear light source will be described that has a 
substantially cylindrical configuration, and that is moved translationally. It should be 
noted, however, that the apparatus and method of the present invention is not limited to 
a linear light source that is moved translationally along a substantially straight trajectory, 
and that any other type of elongated light source that extends from one end to another 
can be used. For example, an extended light source may be used that has a curvilinear 
or an arcuate configuration, or that has a wavy or sinusoidal configuration. Such 
extended light sources may be moved rotationally, or may be moved along a curvilinear 
or an arcuate trajectory. 

[0017] In oven/iew, the apparatus 100 includes a linear, elongated light source 110; an 
actuator 120 that moves the light source 110 across over the surface of the sample 
object 130, whose surface reflectance properties are being measured; an optical 
imaging system 140 that acquires a series of images as the light from the light source 
110 moves across the object 130; and a data processor 155 that processes the image 
data generated by the optical Imaging system 140 so that the surface reflectance 
properties of the object 1 30 can be determined. A light box (not shown) or other area 
illumination source may be provided behind the object 130 and illuminated before or 
after the light source is moved. The light source 1 10 is moved in such a way that light 
from the light source 110 sweeps across and illuminates the entire surface of the object 
1 30 during a single pass of the light source 1 1 0 over the object 1 30. In the embodiment 
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illustrated in FIG. 1, the object 130 is shown as having a flat surface; however, objects 
having any kind of non-flat configuration can be used as the sample object. Objects 
having non-flat surfaces are described in paragraphs [0060] - [0068]. 

[0018] The optical imaging system 140 generates a series of images of the object while 
the light source 1 10 is moved over the object 130. The optical imaging system 140 
may, in one embodiment, be placed at a single viewing direction with respect to the 
object throughout the motion of the light source 1 10. The apparatus 100 may include a 
laser 160 that forms a laser stripe scanner, together with the optical imaging system 140 
and the actuator 120. Surface geometry variations of the object 130 can be recorded 
using the laser stripe technique. The apparatus 100 may also include a translucency 
measurement system (not shown) that measures the translucency parameter puans- 

[0019] In the embodiment shown in FIG. 1, the light source 110 device is a white neon 
tube, and has a linear and substantially cylindrical configuration. As mentioned earlier, 
any other type of extended and elongated light source may also be used. A neon tube 
has a lower flicker and whiter spectrum, compared to a fluorescent tube, and a lower 
heat output compared to an incandescent light. The neon tube may, by way of 
example, be about 1 cm in diameter and about 50 cm long, although light sources 
having any other dimensions may also be used. 

[0020] In the embodiment shown in FIG. 1 , the actuator 120 is a simple translational 
gantry that moves the linear light source 110 along a one-dimensional rectilinear 
trajectory, whose direction is shown in FIG. 1 by an arrow. As mentioned previously, 
however, any other type of actuator or motion platform can be used, including but not 
limited to a rotational gantry, and to actuators configured to impart motion to the light 
source 110 along a curvilinear or an arcuate trajectory, or to being moved manually in a 
hand-held manner by an operator. The translation gantry 120 shown in the illustrated 
embodiment is configured to move the linear light source 110 horizontally across over 
the surface of the object 130, at a fixed distance h. In one form, the light source 110 
may be mounted at the ends 1 12 and 1 14 to two trolleys 116 whose grooved wheels 
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ride along two L-beams or rails 1 18. A drive motor 121 , controlled by a motor controller 
122, may drive the motion of the gantry. 



[0021] The optical imaging system 140 is a digital camera in the illustrated embodiment, 
although any other type of optical imaging system may be used. In one embodiment, 
the camera 140 captures high resolution photographs every few seconds from a single 
viewing angle with respect to the object 130, while the light source 110 is moved across 
the object 130 during a time period. In other embodiments of the invention, the camera 
140 may be positioned at two or more viewing angles with respect to the object 130, 
and the light source 1 1 0 may effect two or more passes across the object. As known in 
the art, an image captured by a digital camera is formed of a plurality of pixels (typically 
a two-dimensional array of pixels), where the pixel value of a given pixel represents the 
image brightness of a unit area on the surface corresponding to that pixel. The 
photographs may have a resolution of about 3072 x 2048 pixels, by way of example, 
although a camera 140 having any other resolution can be used. The optical imaging 
system 140 may acquire images with three spectral sensitivity channels corresponding 
to reflectance in the red. green, and blue areas of the spectrum, although a system 
having additional spectral channels within or outside of the visible spectrum could also 
be used. 

[0022] The apparatus 100 may include a synchronizer 180 that allows the photographs 
to be generated and the gantry trolleys translated in a synchronized manner. For 
example, the synchronizer may include a processor containing software created using 
the control API of the camera 140, and the API of the gantry 120. Upon 
synchronization, a photograph may be taken, for example, for every millimeter of 
incremental motion of the light source 1 1 0. for example. Typically, the time period in 
which the motion of the light source 1 10 takes place may be about 30 seconds to about 
30 minutes, depending on the speed of the image capture, and a few hundred images 
are captured during this time. 

[0023] The laser 160 forms, together with the camera and the gantry, a laser scanning 
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system or a laser stripe profiler. The laser 160 emits a plane of laser light 162, which 
forms an illuminated stripe 164 on the surface of the object 130. The illuminated stripe 
is viewed by the camera 140, which is disposed at a distance from the laser plane 162. 
As the light source 1 10 is moved, the laser stripe 164 is also scanned throughout the 
surface of the object 130. In one embodiment, the laser 160 is a miniature structured 
light diode laser, having a 60 degree line lens mounted to project the laser stripe parallel 
to and about 38 mm behind the linear light source 110. Surface variations cause 
deformations in the stripe, as seen from the camera 140. These deformations can be 
used to recover variations in the geometric structure of the object 130. 

[0024] The data processor 155 is configured to process the image data, generated by 
the camera 140 as a series of photographs of the illuminated object 130 is taken, so 
that the surface reflectance parameters can be determined for every point on the 
surface of the object 130. As is well known, reflectance is defined as the ratio of the 
energy of reflected light to the energy of the incident light. As known, surface 
reflectance can be described in terms of two components, namely diffuse reflectance 
and specular reflectance. Diffuse (or "Lambertian") reflection occurs when light is 
scattered substantially equally in all directions as it reflects from the object surface. A 
perfectly Lambertian surface that is subject to unifonn illumination has a fixed radiance 
regardless of its orientation. Specular reflection occurs when light is reflected 
substantially in the "mirror direction," which means that the angle of reflection is 
substantially equal to the angle of incidence, or distributed thereabout. Specular 
reflection thus leads to a glossy or mirror-like appearance. 

[0025] Diffuse reflection is characterized by a single parameter per color channel, 
namely the diffuse reflectance parameter pd that is representative of the proportion of 
incident light that undergoes diffuse reflection. On the other hand, there are two 
parameters per color channel associated with specular reflection, namely the specular 
reflectance parameter ps and the specular roughness parameter a. The specular 
reflectance parameter ps represents the proportion of incoming light that undergoes 
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specular reflection. Materials such as soot or chalk have small values of ps, while 
materials that have glossy surfaces, such as glass and polished metal, have larger 
values of ps. The specular roughness parameter a is indicative of the microscopic 
roughness of the surface. Larger values of a lead to a spreading or blurring of the 
specular reflection, i.e. are characteristic of rough, unpolished surfaces that provide a 
blurred specular reflection, while smaller values of a are characteristic of smooth, 
polished surfaces that provide a sharp, un-blurred specular reflection. 

[0026] Because of the omni-directional nature of diffuse reflection, the diffuse 
reflectance parameter can be observed and determined relatively easily. On the other 
hand, the specular reflectance parameters are harder to observe and estimate, since 
specular reflection can only be observed within a limited range of viewing angles with 
respect to an illumination direction. For these reasons, it can be very difficult to reliably 
estimate both the diffuse and specular reflectance parameters of an object surface, as 
explained previously in the background section of this application. By using an 
elongated and extended light source, rather than a point light source, the apparatus 100 
allows both the diffuse and the specular reflectance parameters of an object surface to 
be estimated reliably, as described more fully in this section. 

[0027] To capture a data set using the apparatus 100, the object 130 is placed on a light 

box (not shown) between the two rails 118. On either side of the object 130, calibration 

strips (not shown) may be placed, the strips consisting of diffuse and sharp specular 

materials. In order to measure the light reflection at a specific point P on the object 

surface, the surface point P must be observable from the camera position, and light 

from the light source 110 must illuminate the surface point P. The camera 140 may be 

placed on a tripod, looking down at the object 130 at an appropriate angle of incidence 

from perpendicular to the object 130. The angle of incidence should be chosen so that 

the observed position of the diffuse and specular peaks are adequately separated, 

without unduly foreshortening the object's appearance in the camera 140. In one 

embodiment, the angle of incidence may be approximately 55 degrees from 

perpendicular, although the camera 140 may be placed at other angles of incidence. 
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[0028] The light source 1 10 is then attached to the gantry 120, and the light source 110 
is turned on. The laser 160 is also turned on, so that a plane 162 of laser light is 
projected onto the light source 110. The gantry drive motor 121 is then activated so that 
the light source 110 undergoes translational motion, during a time period. Once the 
gantry 120 starts moving, the time lapse shutter release on the camera 140 is released 
so that a photograph of the object 130 is taken at each one of a plurality of N time points 
ti (i = 1, , . N) within the time period of motion of the light source 110, as the light 
source 110 moves across the object 130. The result is that N photographs are 
generated by the end of the time period of motion. For example, a photograph may be 
taken every few seconds as the light source 110 moves through the object 130. The 
control software in the synchronizer 180 then alternates between translating the gantry 
and taking photographs of the object. The recording is stopped when the laser stripe of 
the light source has moved past the final edge of the object 130. Typically, this may 
take from approximately 30 seconds to 30 minutes, depending on the speed of the 
image capture, although the process may be carried out even more quickly if necessary 
(for example a fraction of a second) in embodiments in which the speed of image 
capture is ultra-fast. 

[0029] The image data generated by the camera 140 are processed by the data 
processor 155. Each digital image or photograph is represented by a 2D array of pixels. 
The camera's position, orientation, and focal length are derived, so that the image 
coordinates (i.e. the coordinates of the pixels) can be correctly related to the 
coordinates of the corresponding points on the surface of the object. Using well known 
methods, for example known photogrammetric modeling techniques, a projection 
function may be constmcted that projects image coordinates to their corresponding 3D 
location P on the surface of the object as determined In an x-z planar coordinate 
system. 

[0030] The image data may be represented as luy(t), where t ranges from % to U (N 

being the number of images generated during a single pass of the light source over the 

object), {u,v) refers to the coordinates of a pixel in the 2D array, and lu,v(t) provides a 
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graph of the pixel's intensity as the light source 1 10 moves over the corresponding point 
on the object's surface. Such a graph is referred to in this application as the reflectance 
trace of a pixel. The reflectance trace of a pixel is indicative of the observed intensity, at 
each time point ti (I = 1 , . . . , N) of the light reflected from a point on the object surface 
that corresponds to that pixel. 

[0031] FIG.s 2A, 2B, 2C, and 2D illustrate the measured reflectance traces for a variety 
of materials. FIG. 2A shows the reflectance trace for diffuse vellum. FIG. 2B shows the 
reflectance trace for shiny black paper. FIG. 2C shows the reflectance trace for gold. 
FIG. 2D shows the reflectance trace for blue decal. The reflectance parameters pd, Ps, 
and a can be determined with respect to each color channel (RGB, or red, blue, and 
green), so the diffuse color of a surface point is given by the RGB triple (PdnPdg.Pdb), and 
the specular color of a surface point is given by the RGB triple {psnPsg.Psb), In the 
graphs shown in FIG.s 2A - 2D. the red color channel is shown as a solid curve; the 
blue color channel is shown as a dashed curve; and the green color channel is shown 
as a dotted curve. 

[0032] In a reflectance trace, a peak corresponding to the specular reflection of the pixel 
typically appears first, followed by a broader peak corresponding to the diffuse peak of 
the pixel, followed by a red spike corresponding to the time at which the laser stripe 
passes over the surface point corresponding to the pixel. This is shown in the 
reflectance traces plotted in FIG.s 2A-2D. As the light moves across the object, the 
specular lobe reflection appears first near the time tm at which the light source Is at a 
mirror angle with respect to the camera, followed by the diffuse reflection at time td 
when the light passes directly above the surface point. 

[0033] As seen from FIG. 2A, diffuse materials such as diffuse vellum may not exhibit a 
significant peak corresponding to the specular lobe expected at time tm. As seen from 
FIG.s 2B and 2C, relatively glossy materials such as shiny black paper (shown in FIG. 
2B) and gold (shown in FIG. 2C) may not exhibit a significant peak corresponding to the 
diffuse lobe expected at time td. As shown in FIG. 2D, materials such as blue decal 
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exhibit both a relatively broad specular lobe and a relatively broad diffuse lobe. For 
diffuse vellum (shown in FIG. 2A) and for gold (shown in FIG. 2C), a peak 
corresponding to the laser stripe, used to detemiine the surface point's height, is visible 
at the right. 

[0034] To determine the reflectance parameters ps, pd, and a from the measured 
reflectance traces, a parameterized model fitting technique is implemented by the data 
processor 1 55. The data processor 1 55 first computes a table of synthesized 
reflectance traces. This table shows how the diffuse and specular reflectance lobes 
would appear under a virtualized version of the moving light source, for a variety of 
model reflectance parameters forming a predetermined set. Then, for each pixel, the 
measured or observed reflectance trace (i.e. the series of intensity values for each time 
point ti at which the images were captured) with the tabulated synthesized reflectance 
lobes, to determine which reflectance model parameters most closely produce the 
observed reflectance values. 

[0035] The data processor 155 may include a computer-readable medium having stored 
therein computer-readable instructions for a processor. These instructions, when read 
and implemented by the processor, cause the processor to input and store the image 
data received from the camera, and to implement the steps described in the previous 
paragraph [0034]. namely: 1) measure a reflectance trace for each pixel, wherein the 

reflectance trace indicates the recorded intensities at each time point ti (i = 1 N) of 

light reflected from a surface point corresponding to the pixel; 2) compute for a table of 
synthesized reflectance traces, each synthesized reflectance trace being indicative of 
the intensity, at each time point, of light originating from a virtualized rendition of the 
light source and reflected from a surface point that corresponds to the pixel, and each 
synthesized reflectance trace being computed using one of a predetermined set of 
model surface reflectance parameters; and 3) compare, for each pixel, the measured 
reflectance trace to the table of synthesized reflectance traces, so as to detemiine the 
surface reflectance parameters that best fit the measured reflectance trace. The 
computer-readable medium may be any medium known in the art. including but not 
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limited to hard disks, floppy diskettes, CD-ROIVIs. flash memory, and optical storage 
devices. The computer readable instructions discussed above may be provided through 
software that is distributed through the Internet. 

[0036] This reflectance model fitting procedure requires that the line equation l(t) for the 
position of the moving linear light source be known, for each image l(t). The data 
processor 155 obtains the line equation by first detemnining the time-varying position of 
the laser stripe /(/) . This is done by marking the line of the laser stripe's intersection 
with the xz plane in each of two images in the image sequence, one at ta when the laser 
is near the top of the frame and one at tb where the laser is near the bottom of the 
frame. Each image-space line is then projected onto the xz plane in object space, to 
compute /(fjand All other values of /(o are linearly interpolated, based on the 
values at ta and tb. Since the light source 1 10 is at a height h and at a fixed distance d 
in front of the laser 160, the position of the light source is given by 

l(t) = iit)+ (dsinp, h, dcosp), (1) 
where p is the angle at which the light source is mounted, with respect to the direction of 
the gantry motion. 

[0037] Using equation (1) for l(t), which provides the position of the linear light source as 
a function of time, the time at which the light source is directly above the surface 
point, and the time f„, at which the light source is at a mirror angle to the surface with 
respect to the camera can be computed for any surface point P. Generally, lies near 
the specular peak and td is situated near the diffuse peak. 

[0038] FIG. 3 illustrates the registration of data representative of a reflectance trace, as 
the light source 1 10 is moved across the object surface. The arrows in FIG. 3 indicate 
the motion of the light source 1 1 0, for which a cross-sectional view is illustrated in the 
figure. For each pixel having coordinates (u.v) in the Image plane and corresponding to 
a surface point P. the 3D position and orientation of the camera and a model of the 
movement of the light source is used to determine the time tc when the light source is 
directly above the surface point P. and the time t„, when the light source is at a mirror 
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angle {9r) to the surface with respect to the camera. In FIG. 3, the reflectance trace in 
the background shows the amount of light reflected by the surface point P on the object 
surface toward the camera 140, as the light source 110 moves across the object 
surface. The shape of the reflectance trace shows a specular peak 205 and a diffuse 
peak 210 at the corresponding time points tm and td, as well as a laser stripe peak. 
Also shown in FIG. 3 is A = -f^, which is used to delimit the region in which a 

reflectance trace is analyzed up to the area ^„ ± A . 

[0039] A specific analytic reflectance model can be used in this model fitting technique, 
to fit the data observed with the apparatus 100. In particular, the isotropic Gaussian 
lobe model developed by Ward is used in this section to describe reflectance model 
fitting. The Ward model is used because of its combination of simplicity and physical 
accuracy; however the reflectometry apparatus and method described in this section 
can be used with any other mathematical models as well, with very satisfactory results. 

[0040] The Ward model specifies that a surface point P will reflect light from a direction 
{0.,^.) to a direction (<9,,<2JJ with the following distribution function U 

[0041] In the distribution function given in equation (2) above, 5 is the angle between the 
surface normal n at surface point P, and the half vector h between the incident and 
reflected directions. As explained earlier, the reflectance parameters Pd, ps, and a may 
be determined with respect to each color channel (RGB, or red, blue, and green). The 
specular color (PdnPdg.Pdb) of a surface point P is usually spectrally even for dielectric 
materials such as plastic, and has a particular hue in the case of metals such as gold 
and bronze. Usually, the same a (roughness) parameter can be used for all color 
channels. 

[0042] In one embodiment, the data processor 155 is configured to estimate a based on 

a weighted average of the three color channels. The data processor 1 55 can be 
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configured to analyze the image data to estimate (Pd.Ps.a) for every point on tfie object 
surface, as described furtlier below. Additionally, a surface normal « and a 
displacement d can be recovered for each surface point using laser stripe scanning, as 
described in paragraphs [0060] - [0068]. Further, the translucency ptrans of each 
surface point can also be estimated. In sum, a parameter vector {Pd,p„P,rans'^'d)cax\ 
be reliably determined for every point on the object surface, using the apparatus 100. 

[0043] A discrepancy results in this model fitting process, because the distribution 
function fr in the Ward reflectance model specifies reflected light for each specific 
incident angle of illumination, whereas the reflectance measurements lu,v(t) by the 
apparatus 100 result from light reflected from an entire area of incident illumination, 
namely the cylindrical linear light source 110. To address this discrepancy, a virtual 
version of the linear light source 1 10 is created by the data processor 1 55. The 
predicted appearance of its reflected light is calculated in advance, for a variety of 
diffuse and specular parameters that form a predetermined set. In other words, the 
data processor 1 55 generates a pre-computed table of synthesized (or rendered) 
reflectance traces. The data processor 155 then compares the statistical characteristics 
of the synthesized reflectance traces to the statistical characteristics of a real pixel's 
reflectance trace that is actually observed and measured, in order to determine which 
reflectance model parameters best correspond to the observed data. 

[0044] With respect to the diffuse and specular parameters, the model fitting process is 
described in this section for the case of flat surfaces, not taking into account any 
variations in surface normal and surface height. The data processor 1 55 registers the 
observed or measured reflectance traces into a common coordinate space. The 
appropriate table of pre-synthesized or pre-rendered reflectance traces, to be fit to the 
data, is then computed. Finally, the diffuse and specular parameters of each surface 
point is determined by comparing the statisfics of the real data to the rendered or 
synthesized basis data. 

[0045] In particular, the data fitting process is one of finding those values of Pd. Ps and a 
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such that for each pixel the following equation Is satisfied: 

m = p,D{t) + p,S„(t) (3) 



[0046] In equation (2) above, l(t} represents the total observed reflectance intensity. D(t) 
represents the diffuse reflectance intensity, and Sa (t) represents the specular 
reflectance intensity at a roughness parameter a. All intensities are expressed as a 
function of time t, where t ranges from ti to tN as the light source effects a single pass 
over the object. 

[0047] It is important that the reflectance function fr be specified in terms of light from an 
extended elongated light source rather than in terms of light from a point light direction 
at [e„(pi) . Accordingly, in one embodiment, the data processor 155 is configured to 
numerically integrate the distribution function fr across the light source surface for a 
range of surface roughness parameters a and of light source positions relative to the 
pixel. In one embodiment, the integrations are canried out under the assumption that 
the viewing direction ie,,i^,) is perpendicular to the linear light source, i.e. that ^,=0 
and 0^ is constant. 

[0048] In one embodiment, the data processor 155 stores the results of the tabulations 
of synthesized reflectance traces in a series of functions Sa(t), which correspond to the 
height of a specular lobe with Ps = 1 for a range of light source positions. In one 
embodiment, the parameterization of t is chosen so that at f = 0, the light source is 
directly above the surface point, and that at f = 1 the light source is at the mirror angle 
with respect to the surface point and the viewing direction. The function D(t), which 
corresponds to the height of a diffuse lobe with = 1 for the same range of light 
positions, is also computed. 

[0049] In one embodiment, the linear light is rendered or virtualized as a cylindrical light 
having a diameter equal to the diameter of the actual linear light source 110. In this 
way, the sharp specular peaks are made to match accordingly. To render or virtualize 
the cylindrical light, the light is uniformly sampled, transversely and radially. The 
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specular fitting process can be speeded up by computing the mean |j and the standard 
deviation a of the shape of each specular lobe in the table. These numbers m and a 
characterize the position and breadth of the specular lobe as produced by the linear 
light source. 

[0050] In one embodiment, the data processor 155 is configured to first fit the diffuse 
lobe of the linear light reflectance trace, thereby determining the pd parameter for each 
color channel. Because it is assumed that every surface point P has a vertical surface 
normal (i.e. that the object surface is flat), the diffuse peak is expected to occur at a time 

when the light is directly above the surface point. The specular peak is assumed to 
be at a sufficient distance away from the diffuse peak so that its contribution to the 
reflectance trace is negligible at td- The height the height of diffuse peak Id is measured 
as the height of the reflectance trace at td- In one embodiment, the amount of light 
falling on a pixel (i/, v) is determined by including a strip of diffuse material of known 
reflectance pstandard along the sides of the object. The height of the diffuse peak Utandard 
is measured for pixels on this known sample. Pd is then computed using the following 
equation: 

p^^l^,Pstandard_ (4) 
^standard 

where Isiandard/pstandam IS 3 measurement of the irradiance at the object surface. 

[0051] Once prf is calculated, the data processor 155 proceeds to determine the 
specular reflectance parameters of the sample surface point. Since the diffuse lobe is 
broad, its contribution cannot be assumed to be negligible in the region of the specular 
peak. Accordingly, the data processor 155 subtracts the contribution of the synthesized 
diffuse lobe from the reflectance trace, before fitting the specular peak. 

[0052] FIG.s 4A. 4B. 4C. and 4D illustrate the fitting of observed data to a 
parameterized reflectance model, using a table of pre-computed synthesized 
reflectance traces. FIG. 4A shows the original reflectance trace of the sample object 
130. FIG. 4B illustrates the fitting of the diffuse lobe. i.e. a pd is chosen such that pd D(t) 
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matches the height of the diffuse peak. FIG. 4C illustrates the subtracting of the diffuse 
peak. In FIG. 4C, the fitted diffuse peak is subtracted from the reflectance trace to 
isolate the specular peak. 

[0053] Once the diffuse lobe is subtracted, the specular lobe is examined 
independently. FIG. 4D illustrates the fitting of the specular peak. Specular peaks 
generally lie near the mirror angle tm, and further away from td. In the embodiment 
illustrated in FIG. 4D. the data processor 155 computes the standard deviation o of the 
specular peak, and uses a to choose the appropriate specular roughness parameter a. 
The specular reflectance parameter ps is determined as the ratio of the total energy of 
the specular peak compared to the energy of the specular sample Sa(t) in the 
reflectance table to produce the modeled or synthesized specular peak in FIG. 4D. 

[0054] Specifically, the data processor 155 characterizes the specular peak In temns of 
its mean p, standard deviation a, and total energy Uvg as follows: 

10055, . = v^ (5) 

[0056, ^'-^^ff^ 

[0057] 5 = v^/(0 (^) 

[0058] In one embodiment, the limits of the summations in the above equations (5) - (7) 
are made to range from tn, -A to +A. This means that the region of J(t) that is 
considered lies in the neighborhood of U with a radius equal to the distance between td 
and tm- All values may be normalized using a scaling factor v = l/(2A). in order to 
account for the differences in widths for different pixels due to slight perspective effects 
In the camera. 

[0059] The data processor 155 then searches the synthesized reflectance trace table, in 
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order to find a specular peak having the same standard deviation a as that observed in 
the actual specular peak. The a value that produced that specular peak is then chosen 
to be the specular roughness parameter of the pixel. To determine the desired specular 
reflectance parameter ps, the ratio of the lobe's sum S to the sum of the specular lobe 
with the roughness parameter a in the table, is computed. This ratio is scaled with the 
same scaling factor as used for the diffuse component, as seen in the equations above. 

[0060] The technique described above assumes that the object surface is flat. If the 
object has surface normal variations, i.e. a non-flat surface, the surface reflects light 
differently. A surface normal map can be recovered using the apparatus 100, by 
effecting two passes of the linear light source over the object, at different diagonal 
angles. From these two passes it is possible to estimate variations in both components 
of the surface normal. For non-flat surfaces, a surface height map, i.e. an estimation of 
the surface displacement d, can also be recovered, using the laser stripe system. The 
surface height map can be used to tune the ta and tn, values for each pixel, as well as to 
provide a displaced surface for rendering. 

[0061] FIG. 5 illustrates the use of laser stripe scanning to measure the variations in 
surface geometry of an object. Variations in the surface height change the temporal 
location of the mirror angle, so in order to maintain registration a laser stripe 164 is 
attached to the linear light source 1 10 to measure the surface shape of the object 130 
(now shown with a bumpy, non-flat surface). The laser 160 (see FIG.1) produces a red 
laser stripe 164 which projects a vertical plane of light 162 (see FIG. 1 ) onto the object 
1 30. about 38 mm behind the light source 110. For each pixel {u.v), the time at which 
the laser stripe crosses the corresponding point on the object is detected, by locating 
the pixel lu.v(t) which has the brightest red component. Intersecting the camera ray VP 
with the plane of the laser at the time the laser stripe 164 crosses pixel {u. v) yields 
point Q on the surface. To obtain the point P on the object surface corresponding to the 
pixel image coordinate {u.v), the camera ray corresponding to the pixel is intersected 
with the plane of the laser to obtain the surface point P, as illustrated in Fig. 5. The 
appropriate td and t„ values for point P can then be computed as described earlier. The 
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displacement map is used to adjust the mirror angle position tm for the raised surfaces, 
as well as to provide a geometric model of the object. 

[0062] To estimate the variations in surface normal, the object is scanned twice, with the 
light source in two different positions. For example, in one embodiment the light source 
may be positioned at two diagonally opposite viewing angles with respect to the 
camera. If a pixel's surface normal h points toward the approaching light, its specular 
peak occurs earlier in l(t), and if the surface normal points away from the approaching 
linear light source, its specular peak occurs later. The two light source directions thus 
allow both components of the surface normal to be estimated. 

[0063] To determine how specular peaks respond to changes in surface normal, In one 
embodiment, four different reflectance tables are rendered, for a p = 15° degree 
diagonal light source. In this embodiment, the first two reflectance tables are rendered 
with the surface normal set to ±5 degrees rotated about the z axis (yielding a 
perturbation in the x component) and the second two tables ±5 degrees about the x axis 
(yielding a perturbation in the z component). For each reflectance table, the Sq lobe is 
located that has the same standard deviation a as the pixel's observed specular lobe in 
l(t). The corresponding means Mx-.Mx+,Mz-,Mz+ of each of these lobes are then found. 
These four means are used to produce a bilinear function f+i5(Ax,Az) mapping the 
normal perturbation to the means. 

[0064] By symmetry, a similar function f.i5(Ax,Az) is constructed for (3 = -IS"^ in this 
embodiment, by simply swapping the values of Mx- and Mx+. For the pixel that is being 
considered, the data processor solves for the normal perturbation components Ax and 
Az, by equating f+i5(Ax,Az) and f.i5(Ax.Az) to the pixel's actual measured means for the 
two runs, namely p+is and p.is. This yields a 2 x 2 linear system of equations, as 
follows: 

[0065] = M.- +^^(/^.. -M..) (8) 
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[0066] = M.. +^(/^.- -^^^M^iM.. -M.-) (9) 

[0067] Because the above-described technique for computing surface normals depends 
on analyzing specular reflection, it works relatively well on specular surfaces and 
relatively poorly on diffuse surfaces. For this reason, in one embodiment the final 
surface nomnal map is produced by combining the surface normals estimated by 
specular reflection with surface normals obtained by differentiating the laser-scanned 
displacement map d. Once a surface normal has been estimated for each pixel, the 
diffuse and specular parameters may be re-estimated, based on the improved 
knowledge of the surface characteristics. 

[0068] In one embodiment, the diffuse and specular parameters are re-estimated by 
adjusting the model of the diffuse lobe to be rendered with based on the new and 
improved determination of the surface normals. In this embodiment, a 20 x 20 table of 
diffuse lobes DXz(t) is pre-computed, for surface normals varying in x and z, and 
bilinear interpolation is used to create a D'(t) for the particular surface normal. From this 
table, pd is re-computed, and a new specular reflectance trace i'{t) = m-D'it)\s then 
produced. From this new reflectance trace, a new Sa(t) is fitted, thereby obtaining new 
parameters Ps and a. One iteration of this procedure was found to significantly increase 
the consistency of the specular roughness parameters. 

[0069] In the embodiment described with reference to FIG. 5. a technique has been 
described in which the variations in the surface nomials and surface heights of the 
object (i.e. the 3D surface geometry of the object) is obtained by using the laser stripe at 
the same time the surface reflectance parameters p* Ps. and a are being measured. In 
other embodiments, the 3D surface geometry of the object may be recovered using 
alternative techniques, either before or after the capturing of the surface reflectance 
data. These alternative techniques include, but are not limited to, the following: 
1 ) physical measurement of the surface geometry variations: 2) structured illumination: 
and 3) forms of laser scanning other than the laser stripe technique. Alternatively, the 
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surface geometry may not need to be estimated at all in cases in which the object has a 
known geometry, for example has a completely flat surface. 

[0070] In the embodiments described in paragraphs [0039] - [0069] above, an isotropic 
reflection model has been described, and methods have been described in which up to 
two passes of the light source are made over the object, from two different directions 
(for example from two diagonal directions). In alternative embodiments, non-isotropic 
reflectance models may be used, in order to recover anisotropic reflectance properties, 
which are exhibited for example by brushed metal or by cloth fibers. In these 
embodiments, three or more passes of the extended elongated light source may be 
made over the object. 

[0071] FIG.s 6A and 6B illustrate the measurement of the translucency parameter ptrans 
using the apparatus 100, In accordance with one embodiment. Thin objects such as 
manuscripts can be translucent, which means that they transmit light through the front 
when lit from behind. The data processor solves for this translucency component ptrans 
by taking one additional image Ww/t of the object 1 30, as illuminated from behind by a 
light box 1 90. as well as an image hghtbox of the light box 1 90 with the object 1 30 
removed. A set of two such images are shown in FIG.s 6A and 6B. 

[0072] To determine the amount of transmitted light for each pixel of each color channel, 
in one embodiment, the data processor computes ptrans-lbackin/liigMbox, to obtain the 
percentage of light transmitted at each pixel. In the reflectance model used In this 
procedure, it is assumed that any light transmitted through the material becomes 
diffused, so Ptrans IS not measured for different incident and outgoing directions. This is 
a simplified model of translucency. and the simplified model was found to approximate 
the scattering characteristics of the object with sufficient precision. 

[0073] In sum. the reflectometry apparatus and method described above used an 
extended and elongated light source, to produce a data set that supplies sufficient 
information to reliably and independently estimate the material's diffuse and specular 



-21 - 



reflectance properties, without having to Independently observe all the different 
illumination directions. Using a linear, extended light source for reflectonnetry provides a 
number of advantages, compared to using a point light source. For example, the light 
source needed to make just one pass over the object for a single viewing direction in 
order to have it exhibit both its diffuse and specular reflectance characteristics at each 
surface point. Also, the contrast ratio between the specular and diffuse peaks was 
found to be reduced, allowing for standard digital Imaging systems to acquire the 
reflectance data. Further, the mechanics for moving a light source in just one 
dimension are simple and inexpensive to build. Accordingly, the specular and diffuse 
reflectance properties of an object surface, including non-flat surfaces, could be reliably 
estimated in a time-effective and cost-efficient manner. 

[0074] While the reflectometry apparatus and method have been described and shown 
with reference to specific embodiments, it should be understood by those skilled in the 
art that various changes in form and detail may be made therein. Many other 
embodiments are possible. 

[0075] Other embodiments are within the following claims. 
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